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METHOD AND SYSTEM FOR ASSIGNING OBSERVATIONS 



TECHNICAL FIELD OF THE INVENTION 

This invention relates generally to data analysis 
and more particularly to a method and system for 
assigning observations . 
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BACKGROUND OF THE INVENTION 

The problem of associating sets of observations from 
two sensor systems in the presence of bias, random 
errors, false alarms, and misdetect ions is fundamental in 
multi- sensor tracking systems. For example, if two 
sensor systems are tracking a plurality of airplanes, 
each sensor system develops tracks based on what is seen 
in the sky. One tracking system may want to share data 
with the other system and transmits its current picture 
of what it sees to the other system. The second system 
must determine what it has received from the first 
system. In particular, it must determine which data 
points received from the first sensor system correspond 
to the airplanes it is tracking in its current system. 
This is difficult because each sensor system has 
associated error, which makes it difficult to assign a 
data point from one sensor system to the other. Examples 
of errors may include misalignment between the two sensor 
systems, different levels of tolerances, and the fact 
that one system may see certain airplanes that the other 
does not. As described above, each particular system may 
have errors due to bias, random errors, false alarms, and 
misdetections . Therefore it is difficult to simply use a 
set of data received from the first sensor system and 
overlay it with the second sensor system. 

Common approaches to this problem are described in 
Blackman, S. and R. Popoli, Design and Analysis of 
Modern Tracking Systems, Artech House, Norwood, MA, 1999. 
In general, these methods involve separate steps to first 
determine and correct for persistent bias within either 
of the sensor systems. Persistent bias refers to a 
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consistent bias, such as incorrectly measuring a distance 
by the same distance each time. The second step is to 
perform an optimal assignment of the two sets of data, 
which are now assumed to include only random errors. 
This second step of optimally assigning the two sets of 
data is referred to as the global nearest neighbor (GNN) 
problem, and is commonly solved using either Bertsekas * s 
auction algorithm, as described in Bertsekas, D.P., "The 
Auction Algorithm for Assignment and Other Network Flow 
Problems: A Tutorial," Interfaces, Vol. 20, pp. 133-149, 
1990, or a JVC algorithm to minimize assignment costs 
based upon Mahalanobis (or chi-square) distances between 
the observations after bias removal. The JVC algorithm 
is described in Drummond, O.E., D.A. Castanon and M.S. 
Bellovin, "Comparison of 2-D Assignment Algorithms for 
Rectangular, Floating Point Cost Matrices," Proc . of SDI 
Panels on Tracking, No. 4, pp. 81-97, Dec. 1990, and 
Jonker, R. and A. Volgenant, "A Shortest Augmenting Path 
Algorithms for Dense and Sparse Linear Assignment 
Problems," Computing, Vol. 39, pp. 325-340, 1987. 

A problem with these approaches is that the global 
nearest neighbor problem assumes alignment between the 
two sensor systems is good such that (i) errors between 
observations of the sensor system of the same object are 
purely random (Gaussian distributed) , and (ii) errors and 
observations of one object are completely independent of 
errors and observations of other objects. However, 
because of these assumptions, this approach does not 
address a persistent bias, also referred to as 
registration error, between the two sensor systems, which 
is often actually the case. For example, a first 
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measurement system might be rotated 3 0 degrees off of a 
second measurement system. The global nearest neighbor 
formulation works best when both systems hold 
observations on the same objects and can tolerate large 
5 biases in this restrictive circumstance. In the more 
realistic case wherein each system holds some 
observations the other lacks, the global nearest neighbor 
formulation works well only if there are no bias errors. 
Many techniques exist to determine and remove the bias 

10 errors prior to attempting assignment. Often, these use 
comparison of observations on well separated airplanes 
where the correct assignment is unambiguous. 

Image processing techniques have also been applied 
to the problem of assigning sets of observations from two 

15 sensor systems. In that approach, each set of data is 
treated as an image and a peak correlation is attempted 
to be found using a Fast Fourier transform and 
convolutions. This results in a bias between the two 
systems. The bias is removed and the unbiased problem is 

2 0 solved using the GNN approach described above. However, 

in this approach the bias is cured independent of making 
assignments and is therefore not necessarily calculated 
appropriately. As a result, one cannot show that the 
determined solution is a maximum likelihood solution. 
25 In Kenefic, R.J., "Local and Remote Track File 

Registration Using Minimum Description Length, " IEEE 
Trans, on Aerospace and Electronic Systems, Vol. AES-29, 
No. 3, July 1993, pp. 651-655, Kenefic postulated a 
formulation of the observation assignment problem that 

3 0 incorporates a cost function that accounts for both bias 
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and random errors together. However, Kenefic offered no 
efficient algorithm to solve the problem. 
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SUMMARY OF THE INVENTION 

According to one embodiment of the invention, a 
computerized method for assigning observations includes 
receiving a plurality of first observations indicative of 
respective physical parameters observed by a first sensor 
system and receiving a plurality of second observations 
indicative of respective physical parameters observed by 
a second sensor system. The method also includes 
assigning, by a computer, a set of pairs of the first and 
second observations predicted to correspond to the same 
physical parameter. The assigning includes receiving a 
cost function that specifies a cost for each assigned 
pair. The cost is not independent of the assignment of 
any other assigned pairs in the set of assigned pairs. 
The assigning also includes determining the set of 
assigned pairs corresponding to an optimal value for the 
cost function by calculating, by the computer, a 
corresponding optimal value for a directed graph 
representative of possible assignments of first and 
second observat ions . 

Some embodiments of the invention provide numerous 
technical advantages. Some embodiments may benefit from 
some, none, or all of these advantages. An efficient 
algorithm is provided for assigning sets of observations 
that accounts for both registration errors and nodes that 
should not be assigned. Such an approach may result in 
more accurate assignment of observations in a more 
efficient manner than conventional techniques. 

Other technical advantages may be readily 
ascertainable by one of skill in the art. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Reference is now made to the following description 
taken in conjunction with the accompanying drawings, 
wherein like reference numbers represent like parts, and 
which : 

FIGURE 1 is a schematic diagram of a sensor system 
that may benefit from the teachings of the invention; 

FIGURE 2 is a schematic diagram comparing 
assignments of the data observations made by the system 
of FIGURE 1 according to conventional techniques and 
according to the teachings of the invention; 

FIGURE 3 is a flow chart illustrating acts 
associated with definition of an observation assignment 
problem according to the teachings of the invention; 

FIGURE 4 is a flow chart showing acts associated 
with solution of the formulated problem of observation 
assignment according to the teachings of the invention; 

FIGURE 5A is a flow chart showing steps associated 
with forming a directed graph for solution of the 
formulated observation assignment problem according to 
the teachings of the invention; 

FIGURE 5B is a directed graph for solving the 
formulated observation problem according to the teachings 
of the invention; 

FIGURE 6A is an example computer for solving the 
directed graph of FIGURE 5B according to the teachings of 
the invention; 

FIGURE 6B is a block diagram of a portion of the 
memory of the example computer of FIGURE 6A, showing a 
node queue and a solution queue used in solving the 
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directed graph of FIGURE 5B according to the teachings of 
the invention; 

FIGURE 7 is a flow chart illustrating example acts 
associated with solving the directed graph of FIGURE 5B; 

FIGURE 8 illustrates graphs comparing the results of 
example assignments utilizing the teachings of the 
invention to a conventional approach for an example with 
no missing data; 

FIGURE 9 illustrates graphs comparing the results of 
assignments utilizing the teachings of the invention to a 
conventional approach for an example having two missing 
observations ; 

FIGURE 10 is a graph illustrating the efficiency of 
solving the observation assignment problem according to 
the teachings of the invention; 

FIGURE 11 is a graph comparing the timing of the 
solution according to the teachings of the present 
invention and prior techniques; and 

FIGURE 12 illustrates graphs showing the limited 
circumstances under which prior techniques might be 
acceptable . 
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DETAILED DESCRIPTION OF THE INVENTION 

Embodiments of the invention and its advantages are 
best understood by referring to FIGURES 1 through 12 of 
the drawings, like numerals being used for like and 
5 corresponding parts of the various drawings. 

FIGURE 1 is a schematic diagram of sensor systems 10 
that may benefit from the teachings of the invention. 
Sensor systems 10 include a sensor system 12 and a sensor 
system 14. In this example, sensor systems 12 and 14 

10 observe the position of a plurality of airplanes 16. 
Observation may occur through sensing, prediction, or a 
combination of sensing and prediction. In this example, 
sensor system 12 and 14 are radar systems for example 
purposes only; however, the teachings of the invention 

15 are applicable regardless of the type of sensor system 
utilized. For clarity of illustration purposes not all 
airplanes 16 that are utilized in this example are 
illustrated in FIGURE 1. 

Associated with, or included within, sensor system 

20 12 is a representation 18 of the location of airplanes 16 
that are observed by sensor system 12 . Sensor system 14 
is associated with a similar representation 20. 
Representations 18 and 2 0 may differ for a variety of 
reasons. There may be misalignment between systems 12 

25 and 14, errors between systems 12 and 14, or one system 
may not observe all of airplanes 16 that the other system 
observes. The errors for either system 12 or 14 may be 
due to bias, random errors, false alarms, misdetections , 
or other sources. Representation 18 includes a plurality 

30 of observations 22 representing the corresponding 
airplanes 16 observed by sensor system 12. 
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Representation 2 0 includes a plurality of observations 24 
representing the location of corresponding airplanes 16 
observed by sensor system 14. The physical location of 
any airplane 16 is an example of a physical parameter, 
observation of which is represented by observations 22 
and 24 . 

It may be desirable for sensor system 12 to provide 
observations 22 to sensor system 14 for use by sensor 
system 14 . A problem that arises from this sharing of 
observations is correlating which observations 24 
correspond to which observations 22. This may be 
particularly difficult in the situation where sensor 
system 12 includes observations 22 corresponding to 
airplanes 16 that sensor system 14 does not also observe. 
Persistent bias within or between sensor systems 12 and 
14 also makes this problem particularly difficult. 

According to the teachings of the invention, 
observations 22 are assigned to observations 24 by 
calculating a cost function indicative of differences 
between observed values 22 and observed values 24. An 
optimal value for the cost function is arrived at by 
solution of a directed graph representing the assignment 
of observations 22 to observations 24. According to one 
particular embodiment the cost function is such that the 
cost of making a particular assignment of a pair of 
observations is dependent upon an overall hypothesis for 
all assignments. A directed graph is a set of nodes 
connected by arcs, with each arc having a specific 
direction. Traversal of the graph is possible only in 
the direction of the arcs. The shortest path between two 
nodes in a graph is often determined using a dynamic 
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program such as described in Dijkstra, E., "A note on two 
problems in connexion with graphs, " Numerische Mathematik 
1, pp. 269-271, 1959, which is incorporated herein by 
reference for all purposes. Other dynamic programs, also 
referred to as network shortest path algorithms, may also 
be used to solve a directed graph. 

FIGURE 2 is a schematic diagram comparing 
assignments of the data observations 22 and 24 made by 
systems 10 of FIGURE 1 according to conventional 
techniques and according to the teachings of the 
invention. Included in FIGURE 2 is data set 26 and a 
data set 28. Data set 26 includes observations 22, 
observations 24, and a plurality of assignments 30 
associating observations 22 with observations 24 
predicted to correspond to the same physical parameter 
(i.e. the location of a given airplane 16). Such 
assignments are made in data set 2 6 according to 
conventional techniques. As described above, 

conventional techniques make various assumptions that are 
often incorrect in practice and therefore lead to 
erroneous assignments. Data set 28 includes observations 
22, observations 24, and a plurality of assignments 32 
corresponding to associations made between observations 
22 and observations 24 predicted to correspond to the 
same physical parameter. These assignments are made 
according to the teachings of the invention. In this 
embodiment, the assignments in data set 2 8 account for 
both random and correlated bias components. 

In data set 26, all errors are uncorrelated so each 
observation 22 is assigned to the nearest observation 24. 
In this example all examples are wrong. By contrast, 
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assignments 32 of data set 28, generated according to the 
teachings of the invention, are made by recognizing 
errors have both random and correlated bias components, 
generating a common pattern, and assigning observations 
5 22 to observations 24 accordingly. In this example a 
persistent offset exists between observations 22 and 
observations 24, as indicated in FIGURE 2. All 
assignments in dataset 28 are correct. 

y, 

p Techniques for formulating such an observation 

in 

g«l 10 assignment problem to include both persistent 

registration errors as well as the possibility that not 

(J3 all observations 22 are included within observations 24 

81 

are described below in conjunction with FIGURE 3. 

O Solution of the formulated problem is described in 

■ y 

PI 15 greater detail below in conjunction with FIGURES 4 

•W through 7. FIGURES 8 through 12 illustrate example 

fU results and comparisons to prior techniques. 

FIGURE 3 is a flow chart illustrating acts 
associated with definition of an observation assignment 
2 0 problem according to the teachings of the invention. 
Such an observation assignment problem is referred to 
herein as a global nearest pattern (GNP) problem and 
accounts for persistent errors and the possibility that 
observations to be assigned may not constitute a perfect 
25 subset of the observation set to which they are being 
assigned. The formulation of the GNP problem includes 
the following steps: determination of governing equations 
40, assignment of the cost function 42, accounting for 
gating 44, use of feature data 46, and determination of 
30 assignment complexity 48. 
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At step 40, the governing equations are formulated. 
Assume that there are N objects (airplanes 16 in this 
example) in space being observed by systems A (system 12 
in the example of FIGURE 1) and B (system 14 in the 
example of FIGURE 1) , and each system observes a 
potentially different subset of the objects. A develops 
observations (observations 22 in the example of FIGURE 1) 
on m of these, B develops observations (observations 24 
in the example of FIGURE 1) on n of these subject to: 

m<n<N (1) 
False alarms in A or B correspond to observations of an 
object unobserved by the other system. The observations 
are converted to an M-dimensional common reference frame. 
In this frame, 



*y =^><,) +£(£) + 7= IK* 



(2) 



where : 



A set of m observations made by system A (each is a length M 

state vector) 

B set of n observations made by system B (each is a length M 

state vector) 

X true locations of the N objects (each is a length M state vector) 

ix length m vector defining the indices of the m objects in X for 

which A develops observations 
jx length n vector defining the indices of the n objects in X for 

which B develops observations 

P set of m MxM covariance matrices defining random errors in 

each of the m observations in A 
Q set of n MxM covariance matrices defining random errors in 

each of the m observations in B 
G(v) length M vector of Gaussian random numbers, 0 mean, 

variance v 
X A , X B length M bias vectors 

The GNP assignment problem developed ultimately 
relies only upon the relative errors between the sets of 
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observations, hence the covariance of the relative bias 
is needed. The relative registration covariance matrix 
is defined as - 

R = eIIx a -x b \x a -x b Y) (3) 

The assignment problem is to determine the correct 
association of observations in A and B. The desire is 
that Ai is mapped to Bj given that ix(i) = jx(j), and that 
elements of A corresponding to an object unobserved by B 
be unassigned. All assignments are unique, hence each 
observation in A or B can be assigned to either 0 or 1 
observations in the other set. The assignment is 

expressed by the length m integer assignment vector a 
with properties: 

a{i) > 0 A i is assigned to B a(i) ^ 
a(i) - 0 A i is unassigned 

The uniqueness property is expressed as 

fl(0 * <*U) V (j * j and a(j) > 0) (5) 

After the governing equations are formulated at step 
40 a cost function is assigned at step 42. Assuming that 
all items in A are assigned and following standard 
approaches for track- to- track association, the Gaussian 
probability density for a given assignment set is given 
by: 

e -xR- x x T /2 m e -k-*-(o-sh+a.(o)" , k-*-(ii- r l r / 2 

p ° = ^r7R I ? (2*rvki+a m | (6) 

where x is an estimate of the relative bias x A —x B . A 
term referred to as an assignment gate is utilized to 
account for unassigned elements in a and taking the 
negative logarithm of both sides and multiplying by 
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Equation 2 yields the hypothesis score (J a ) to be 
maximized through choice of a: 

Equation 7 assumes at least one assignment in a, and 
the value g, which used in deciding to accept a given 
assignment: g includes the missing M ln(2n) term and is 
described in greater detail below. The bias estimate, x, 
is chosen to maximize the assignment score, represented 
by J" a . The value for this is determined by taking the 
partial derivative of equation 7 with respect to x , 
setting the result to zero, and solving, resulting in: 



x = 



[W[ 0 a(i) = 0}){ t( Vt J 



Again, the bias is computed based upon the assigned 
elements only. With no assignments made, the bias is 
indeterminate. Equations 7 and 8 utilize a simple bias, 
but could be easily reformulated with a functional bias, 
such as a hyperbolic displacement as a function of 
relative position. Other types of bias that may be 
accounted for include scale factor errors and rotation 
errors. Equations 7 and 8 together define the assignment 
score function that a GNP assignment algorithm must 
maximize. A simplification is available in the special 
case of homogeneous error variances (e.g., all Pi = P and 
all Qj =0.) In this case, equation 8 becomes: 



1 £{[ 0 a(i) = 0\ 



(9) 

n : number of non - zero entries in a 
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It is noteworthy that the costs in equation 7 do not 
support generation of a cost matrix as in the classic GNN 
problem. Rather, the cost of any particular assignment 



upon the entire assignment hypothesis. The entire 
assignment hypothesis refers to a hypothesized set of all 
assignments. The integer programming methods used to 
solve the GNN problem are based upon independent costs 
for each assignment and hence incapable of handling the 
GNP problem. This is a feature of the GNP problem that 
utilizes the teachings of a new invention for solution. 

An "equivalent" cost function for the GNN problem is 
defined here. This can be a rough equivalent only, as the 
bias is ignored (the assumption being that the bias is 
zero) . The GNN formulation is in fact found by removing 
the bias related terms from equation 7, with result in: 



In general, the residual covariance Si in equation 10 
would be inflated to account for residual bias errors. 

After assignment of a cost function at step 42, 
gating is accounted for at step 44. Gating refers to 
accounting for non- assignment of an observation, such as 
observation 22 to an observation in second system 14. 
For any potential assignment = j, there are two 

hypotheses: 

H 0 : Ai and Bj represent independent observations and a(i) = j 

should be rejected in favor of a(i) = 0. 
H z : Ai and Bj represent the same object and a(i) = j should 

be accepted. 



a(i)=j 



is dependent upon the bias estimate and hence 




(10) 
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The gate value g is used in the above test. Given the 
interdependence of all assignments in a hypothesis, a 
cost cannot be uniquely defined for any particular 
assignment. The gating approach presented here treats the 
change in score when an assignment is added to a set as 
the cost of that assignment, and hence the value tested 
against gr to choose H 0 or H 2 . 

In the case where system A sends its full set of 
observations, the standard maximum likelihood gate used 
for the GNN problem is applicable but needs adjustment to 
allow for the extra term in equation 7 related to the 
bias. Given true target density over the surveillance 
volume P, , false target densities for systems A and B are 
$ m and , and probabilities for A and B of observing 

a target are P TA and P TB , the maximum likelihood gate 
value is (Blackman 2 , equation 9.15) : 



g = 21n 



TB 



hiA MI2 p p 

_ V- n ) r NTA NTB 

P N TA=PA B b-PTA)+PrrB (11) 

F*NTB = Pi ^TA (l ~~ PtB ) + P FTA 

The GNP formulation is especially useful for a one- 
time object map handover. Typically, an object map has an 
a priori defined maximum number of elements, regardless 
of the true number of tracks present in the source. This 
corresponds to a lower P TA and thus indicates a smaller 
gate value may be required than is given by equation 11. 

There are m+1 terms summed to give an assignment 
score in equation 7 as opposed to m terms in the GNN 
formulation of equation 10. The extra term is due to the 
bias error, and as the first assignment added to a 
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hypothesis is primarily responsible for determining the 
bias, the solution approach here uses 2g as the gating 
value for the first assignment. The direct impact of this 
decision is that entire hypotheses are less likely to be 
gated out given a large bias: gating out a single 
assignment that is marginal is acceptable, but gating out 
an entire hypothesis due to a large bias may not be 
acceptable . 

After gating is accounted for at step 44 , feature 
data may be used at step 46. The cost function given in 
equation 7 explicitly assumes that biases exist between 
the two systems in all dimensions of the common frame of 
reference. However, the formulation is easily expanded to 
include additional feature data and/or observations where 
the residual bias is unimportant (e.g., vehicle 
velocity) . Assuming the feature observations are in 
arrays A f and 5 / with residual covariance F fJ , the 
hypothesis score becomes: 

Stf = W - < 0 K (0 W - B{ {0 ] + In \F iMi) |) 



LV ' MJ h\ g a(i) = 0 



(12) 



Assignment complexity may be determined at step 4 8 
as follows. The upper limit on hypothesis to be tested 
is calculated from simple combination theory. The 
algorithm can choose to make k assignments, 0<k<m. 



There are 



ways of choosing the k objects from the 



smaller set for assignment. For each set, there are n 
ways to assign the first object, (n-1) ways to assign the 
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second, hence 



n! 



ways of assigning the set. Overall, 



(n-k)l 

the total number of hypothesis that can potentially be 
considered is: 



m 



k=o V k j 



(13) 



(it-*)! 

Each of the n h hypotheses requires m assignment decisions. 
A measure of algorithm efficiency is the fraction of 
assignment decisions explored to find the solution: 



?7 = - 



mn. 



(14) 



FIGURE 4 is a flow chart showing acts associated 
with solution of the formulated GNP problem according to 
the teachings of the invention. The flow chart of FIGURE 
4 includes a step 50 of formulating a cost function in a 
form suitable for a directed graph and a step 52 of 
formulating the directed graph. 

The teachings of the invention recognize that a 
chosen algorithm for solving the GNP problem formulated 
and described with reference to FIGURE 3 requires that 
scores be computable for partial hypotheses (e.g., for 
having made fewer than m assignment decisions) , and that 
adding assignment decisions to a hypothesis always 
results in a same-sign change (non-positive in this 
example) in score. Therefore modifications to equation 7 
are made to effect this condition. First, d m ± n is defined 
as the minimum determinant of the residual error matrix 
(Pi + Qj) taken over all combinations of i and j. This 
constant value is added to all scores and subtracted from 
the gate value used. This adds a constant value to all 
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hypotheses and so does not alter which has the minimum 

value. Also, the value Ini^ln ] M \R\) is added to all 

hypotheses and subtracted from the gate value used on the 
first assignment. 

The gate value used on the first assignment made in 
a hypothesis (e.g., first a(i)>0) is: 

g^2g-lnil2n] M \R\) (15) 

The gate value used on the second and subsequent 
assignments in a hypothesis: 

g=g-ln(</ min ) (16) 

The score for a hypothesis at stage s, s is the 

number of assignment decisions made, with n a (n a > 0) 
assignments is: 



" " S fl(0 = 0j 1 0 n a >0] 



Thus an optimal value for the assignment score, J S/ 
according to Equation 17 is desired. According to the 
teachings of the invention, a directed graph may be 
formulated corresponding to Equation 17 and solved for an 
optimal value. In this case, an optimal value is a 
minimum value for J s ; however, according to other 
formulations an optimal value could take the form of a 
maximum value, or other suitable form. 

FIGURE 5A is a flow chart showing steps associated 
with forming a directed graph for solution of the GNP 
problem according to the teachings of the invention, and 
FIGURE 5B is a directed graph 70 for solving the GNP 
problem according to the teachings of the invention. 
Directed graph 70 includes a plurality of nodes 60. Each 
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node 60 corresponds to the assignment of an observation 
from a first set of observations (observations 22) to a 
given one of observations in a second set (observations 
24). Nodes 60 are arranged in stages 62, and directed 
graph 70 includes m+1 stages where m represents the 
number of observations in the set receiving data for 
assignment, which in this example corresponds to the 
number of observations 24. Each stage 62 includes n+1 
nodes corresponding to the n+1 possible hypotheses for 
assignment. The node 60 at stage zero denoted by 
reference numeral 64, is referred to as a root node. All 
arcs 66 between given nodes 60 represent a single 
assignment decision. All nodes in stage m are referred 
to as terminal nodes 68. 

With reference to FIGURE 5A, formulation of directed 
graph 70 is described. At a step 80 nodes 60 in directed 
graph 70 are defined. Each node 60 in graph 70 

represents an assignment hypothesis with some number of 
assignment decisions. Root node 64 has zero decisions 
made, and all terminal nodes 6 8 have m assignment 
decisions and are complete. 

At step 82 arcs 66 in directed graph 70 are defined. 
Each node 62 in directed graph 70 has a single input arc 
66. Therefore directed graph 70 is in effect a tree. 
There is exactly one path from root node 64 to any node 
60 in graph 70. Each arc 66 connecting to node 60 
represents a single assignment decision. Thus, each node 
60 has one more assignment decision than the node 60 
feeding it. A length of an arc 66 is, in this case, the 
decrease in assignment score {J 3 -i ~ Js) resulting from the 
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assignment decision made to reach the assignment 
hypothesis at its terminus. 

At step 84, assignment definitions are made. Root 
node 64 has zero assignment decisions made. Arcs 66 into 
nodes at stage i correspond to assignment decisions on 
the item in A (system 12) . For example, root node 64 
feeds all stage one nodes, and the assignment decision 
made relates to assigning the first observation in A 
(observations 22) to the n observations in B 
(observations 24) . All assignment hypotheses consist of 
unique assignments; the assignment decision associated 
with each arc 66 assigns an observation in B 
(observations 24) that is unassigned in the source 
hypothesis. The structure of graph 70 assures that each 
observation in A (observations 22) is considered only in 
a single stage 62 and cannot be multiply assigned. 

At step 86, a solution of graph 70 is defined. All 
solutions exist at stage m, the terminal stage, where m 
assignments have been made. 

At step 88, graph 70 is searched for one or more 
optimum solutions. Only those portions of graph 70 
touched by the search algorithm are formed. This greatly 
reduces the computations required to obtain an optimal 
solution for graph 70. For practical problems, the 
number of hypotheses in n h , the set of all possible 
hypotheses, is so large that simply enumerating all arcs 
66 on graph 70 is infeasible. This also precludes 
general dynamic programming approaches that provide high 
efficiency based upon a priori knowledge of the graph. 
One example of computational approach for performing the 
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step 88 of searching graph 70 is described below in 
conjunction with FIGURE 6A through 7. 

FIGURE 6A is an example computer for searching the 
directed graph 70 for one or more optimal solutions 
according to the teachings of the invention. Computer 90 
includes, in this example, a processor 92, associated 
storage 94, and memory 96. Also included in computer 
system 90 is an output device 98 and an input device 100. 
Processor 92 may be any suitable processor including 
processors manufactured by, for example, Intel, AMD, and 
Motorola. Storage 94 provides storage for processor 92 
and may comprise any suitable type of storage, such as 
CD-ROM, hard disk drives, or other suitable storage. 
Memory 96 is often random access memory but can comprise 
other types of memory such as read only memory and may 
take any suitable form, including flash memory, CD-ROM, 
hard disk drives, floppy disks, or other suitable forms. 
Output device 98 may comprise any suitable device for 
displaying data processed by processor 92, such as a 
printer, or a display. Input device 100 provides a way 
for a user to provide input to processor 92 and may 
include a keyboard, a pointing device, or other suitable 
input device. 

Stored within memory 96, or alternatively storage 
94, is GNP software 102. GNP software 102 solves the 
directed graph problem described above and therefore 
allows appropriate assignment of observations between two 
systems, such as systems 12 and 14. GNP software may be 
written in any suitable programming language; in this 
example it is written in C++. Operation of GNP software 
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102 is described in greater detail below in conjunction 
with FIGURE 6B and FIGURE 7. 

Computer 90 is only one example of a suitable system 
for executing algorithmic steps for searching directed 
graph 70 for one or more optimal solutions. Other 
examples include digital signal processors, application 
specific integrated circuits, and field programmable gate 
arrays. Other suitable systems that are operable to 
execute predetermined steps according to the invention 
may also be used, whether currently existing or yet to be 
developed . 

FIGURE 6B shows additional details of memory 96 of 
this embodiment illustrating a node queue 104 and a 
solution queue 106 for use in searching the directed 
graph 70 for one or more optimal solutions according to 
the procedure described below in connection with FIGURE 
7. Node queue 104 stores all nodes 60 with partial 
hypothesis (stage < m) that have been touched in the 
search of graph 70 and are candidates for further 
exploration. Nodes 60 are pushed onto queue 104 in 
arbitrary order with respect to assignments, but retrieve 
highest scores first, as described in greater detail 
below. Solution queue 106 is a structure that maintains 
the list of the n. hest solutions. Solution queue 106 
supports adding solutions (nodes at stage n) in arbitrary 
order, popping a best order solution, and returning the 
value of the worst solution in solution queue 106. 
Popping the best or worst value solution refers to 
determining the solution with best or worst value, 
removing it from the queue, and making it available for 
further processing. 
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FIGURE 7 is a flow chart illustrating example acts 
associated with solving the directed graph of FIGURE 5B. 
Other known methods for solving a directed graph may also 
be used for this purpose. Method 110 may be implemented 
5 by any suitable computer to obtain the n best solutions for 
the directed graph 70 described above, and therefore 
determine the best set of observation assignments for the 
N< GNP problem. In general, method 110 maintains a list of 

f«| nodes 60 (partial hypotheses) formed, and selects as the 

jW io one to explore from that node those nodes having the 
# highest current score. The search terminates when the 

selected node 60 for exploration has a score no higher 
than the n th best solution yet found. This assures 
finding the n best solutions because (1) all possible 
jp 15 solutions are represented in the graph, (2) no child 

p hypothesis has a score higher than its parent, and thus, 

M 

(3) the termination criteria provides that all unexplored 
hypotheses would have scores no higher than the solutions 
already found. In the described embodiment only those 

2 0 nodes 60 in arcs 66 actually explored during the search 

are ever formulated. 

The method begins at step 112. At step 114, the no 
assignment solution (the stage m node representing the 
hypothesis of no assignments) score from Equation 18 is 
25 pushed onto solution queue 106. This is the lowest 
possible score assignment hypothesis possible. At step 
116, root node 64 is pushed onto node queue 104. Root 
node 64 corresponds to stage zero with no assignment 
decisions made and has a score of -(m+l)g . Then, at 

3 0 decisional step 118, a determination is made of whether a 

node 60 on node queue 104 with the highest score has a 
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score larger than the worst solution on solution queue 
106. If so, processing continues at step 120. If not, 
processing is concluded at step 132. 

At step 120, the best node 60 from node queue 104 is 
popped. As described above, popping refers to removing 
this solution from the queue and making it available as 
the starting point for further exploration. At step 124, 
/n-s new hypotheses are formed from the node 60 on node 
queue 104. This node 60 has s decisions. The scores for 
these hypotheses are determined and the hypotheses whose 
score decrease exceeds k g g (na>0) or k g g x (na = 0) , where 
k g >\ is a factor used to mitigate the order dependent 

gating artifacts described above are gated out. 

At step 126 a determination is made of whether the 
new hypotheses are at stage m, the terminal stage. If 
so, the hypotheses that survived the gating tests at step 
124 are pushed onto solution queue 106. Then solution 
queue 106 is reduced to hold at most ripest solutions. This 
reduction refers to successively removing the worst 
solution as long as the queue holds more than n be st 
solutions. If the new hypotheses are not at stage m 
(stage s is < m) the hypotheses that survived the gating 
at step 124 are pushed onto node queue 104 at step 130. 
Processing continues at step 118 until the node 60 on 
node queue 104 with the high score does not have a score 
larger than the worst solution on solution queue 106. In 
such a case, n best solutions on solution queue 106 
represent the best solution, as denoted by step 132, and 
all scores have a score of >= -(m + \)g . 
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The above approach may be utilized not only to find 
the N-best solutions for the GNP problem, but may also be 
used to generate the N-best solutions for the GNN 
problem, and may be more efficient than doing so using 
conventional techniques . 

Example results of one embodiment of the present 
invention are described with reference to FIGURES 8 
through 12 . Comparisons of some embodiments of the 
present invention are made to an algorithm that solves 
the GNN problem described above. That algorithm used for 
the comparison data, called gnn-JVC, uses the Jonker- 
Volgenant- Cast anon (JVC) algorithm to solve the cost 
matrix that results from application of equation 10. As 
this formulation assumes the sets of observations are 
unbiased (e.g., that x=0) f an ad-hoc solution is 
required. The approach used is to expand the covariance 
of the observations from A by the covariance of- residual 
relative bias: 

P*=P;+R (18) 

A second algorithm, termed Magic-gnn is used to 
define an upper bound on expected performance. This is 
gnn-JVC but presented with the problem wherein the two 
sensors are in perfect registration due to the effects of 
a magical genie: in effect, R = 0 , and hence the problem 
is exactly the one for which gnn is designed. 

All problems explored are in 3-D space (M = 3) and 
have homogeneous covariances (all observations in A have 
variance P, all observations in B have variance Q) . The 
simple bias formulation in equation 9 was used for the 
approach at the present invention, the log-determinant 
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terms in the cost functions for equations 8 and 10 being 
constants for this case were instead added to the gate 
value g. Solution according to the teachings of the 
invention are referred to in the FIGURES as "gnpl . " 

FIGURE 8 presents relative accuracy of the three 
algorithms for a threat object map handover problem. 
There are 2 0 total objects randomly dispersed in a cube 8 
km on a side (the x, y, and z coordinates are independent 
draws from a uniform distribution) , system A reports 
observations of seven of these to system B, and system B 
holds tracks on all 20 objects (thus m = 7, n = N = 20) . 
The convolution of tracking errors for A and B is 100 
meters 1-a per axis, and there is a residual relative 
registration error of 2 km 1-a . Thus, R is a diagonal 
matrix with values of 4 km 2 on the diagonal, and P+Q is 
diagonal with entries of 0.01 km 2 on the diagonal. The 
metric is assignment errors: there are seven assignments 
to be made with an error counted for each of the 
assignments that is incorrect compared to the true source 
of observations in A and B. The data is for 1000 Monte- 
Carlo runs. As shown, the approach of the present 
invention achieves almost the same performance as Magic- 
gnn, while gnn-JVC is much worse and clearly a poor 
choice for this problem. 

The results in FIGURE 9 are for a nearly identical 
problem, except that there are 22 objects: 2 of the 7 
observations in A have no counterpart in the 2 0 
observations in B (e.g., m = 7, n 20, N = 22) . 

Performance degrades slightly for Magic-gnn and gnpl, but 
gnn-JVC never makes fewer than two errors (all seven 
objects as always assigned to something) . 
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FIGURE 10 presents results from sets of 1000 Monte- 
Carlo runs solving the problem from FIGURE 9, but now 
seeking varying numbers of solutions. The data presented 
shows the fraction of arcs in the directed graph touched 
by the search according to the teachings of the invention 
in finding the solutions. This problem has roughly 
4.41xl0 9 arcs, and in the worst case, about lxlO" 6 of 
those were searched, or roughly 4400 arcs, to find the 
five best solutions. 

FIGURE 11 provides another measure of computational 
performance, this time comparing total solution time for 
same size problems in gnpl and in gnn-JVC. The problem 
defined is has registration errors sufficiently small 
that solutions from both algorithms are identical. The 
particular problem parameters include: 

• 100 meter 1— a tracking error, 0.001 meter 1-a 
Registration Error. 

• All objects in a cube, 8 km on a side. m 
observations in A, n observations in B. 

• The timing data is from 100 repetitions of 20 
patterns for each combination of m/n. 

• Both algorithms are in C/C++. The gnn-JVC time 
includes time to compute the cost matrix. The cost 
calculation includes 

• coarse gating to avoid computing the Mahalanobis 
distance for values unlikely to satisfy the gate g. 

The key result shown in FIGURE 11 is that gnpl is 
reasonably efficient computationally for problems typical 
of handover. For a map of size smaller than 10, gnpl is 
often significantly faster than gnn-JVC. For small 
problems, the gnn-JVC solution time is dominated by time 
to compute the cost matrix, not solution in the JVC 
algorithm. For these same cases, gnpl avoids exploring a 
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large part of the directed graph, in effect using smart 
gating to avoid computing costs for many potential 
assignment pairs. This advantage disappears as m (e.g., 
the object map size) increases. The basic gnpl algorithm 
is useful in this example for values of m up to 25-30, 
depending upon object density, but could be used in much 
larger problems depending upon the specific computer used 
and the problem parameters. 

One ad-hoc approach to solving problems of higher 
order builds on earlier work of Blackman and Banh 3 . Their 
approach is based upon iteration around a gnn algorithm. 
An assignment solution is obtained by gnn, the median 
offset between the assigned pairs in the solution is 
taken as the bias. The gnn solution is repeated with this 
new bias. This is repeated until some termination 
criteria is reached. This approach is reliant upon a good 
initial estimate of the bias. A hybrid approach using 
gnpl has been found successful. First, the gnpl 
assignment solution is found using some number (10 seems 
good) of the observations in A, chosen by some criteria 

(e.g., 10 points on the convex hull defined by A) . The 
resulting bias estimate is used as the initial estimate 
for the iterative solution using gnn. A single iteration 

(gnpl to compute an initial bias, gnn assign, update the 
bias, gnn assign) achieves essentially the full 
performance for a number of cases tried. This method 
provides excellent performance for very large problems, 
with most of the experiments that support this 
description run using 60 x 120 assignment problems. 

Finally, FIGURE 12 presents the relative accuracy of 
assignments achieved for gnpl and gnn- JVC as a function 
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of the ratio of bias (or registration) and tracker 1-a 
values. The problem studied is a 7x2 0 assignment, this 
time with 21 actual objects, hence 1 of the 7 objects in 
A has no counterpart in B. For small tracking errors (the 
5 100 meter 1-a case) , gnpl shows better accuracy for bias 
errors of about the same value. However, with a tracker 
error 3 times larger, gnpl shows a decided advantage 
beginning at a bias error less than half the tracker 
error . 

10 Although the present invention has been described in 

detail, it should be understood that the various changes, 
substitutions, and alterations can be made hereto without 
departing from the spirit and scope of the invention as 
defined by the appended claims. 
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